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Purpose: The patient-centered approach to heahh care does not seem to be sufficiently 
developed in the Italian context, and is still characterized by the biomedical model. In addi- 
tion, there is a lack of validated outcome measures to assess outpatient experience as an aspect 
common to a variety of settings. The current study aimed to evaluate the factorial validity, 
reliability, and invariance across sex of the Health Services OutPatient Experience (HSOPE) 
questionnaire, a short ten-item measure of patient-centeredness for Italian adult outpatients. 
The rationale for unidimensionality of the measure was that it could cover global patient 
experience as a process common to patients with a variety of diseases and irrespective of the 
phase of treatment course. 

Patients and methods: The HSOPE was compiled by 1,532 adult outpatients (51% females, 
mean age 59.22 years, standard deviation 16.26) receiving care in ten facilities at the Santa 
Maria alle Scotte University Hospital of Siena, Italy. The sample represented all the age cohorts. 
Twelve percent were young adults, 57% were adults, and 32%i were older adults. Exploratory 
and confirmatory factor analyses were conducted to evaluate factor structure. Reliability was 
evaluated as internal consistency using Cronbach's a. Factor invariance was assessed through 
multigroup analyses. 

Results: Both exploratory and confirmatory analyses suggested a clearly defined unidimensional 
structure of the measure, with all the ten items having salient loadings on a single factor. Internal 
consistency was excellent (cif=0.95). Indices of model fit supported a single-factor structure for 
both male and female outpatient groups. Young adult outpatients had significantly lower scores 
on perceived patient-centeredness relative to older adults. No significant difference emerged 
on patient-centeredness between male and female outpatients. 

Conclusion: The HSOPE questionnaire seemed to be a tool with high acceptability and excel- 
lent psychometric properties to measure patient-centeredness as a unidimensional construct. 
Limitations and implications for future research are discussed. 

Keywords: patient-centered care, health care services, psychometric properties, patient-reported 
outcomes 

Introduction 

The patient-centeredness framework 
in health care services 

In the last few decades, the patient-centeredness framework (PCF) has developed 
as a new approach to diagnosis and treatment in health care settings. This approach 
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was conceived to overcome limitations of the traditional 
biomedical model. '-^ In contrast with the latter, the PCF high- 
lights the importance of a symmetrical relationship between 
the patient and health profession staff In the biomedical 
model, a role asymmetry existed in the difference in authority 
between health professionals and the patient. The first were 
considered experts, while the patient was a passive recipient 
of prescriptions. 

According to Epstein et al,^ a definition of the concept of 
patient-centeredness includes the following aspects: 

• eliciting and understanding the patient's perspective - 
concerns, ideas, expectations, needs, and feelings 

• understanding the patient within his/her unique psycho- 
social context 

• reaching a shared understanding of the problem and its 
treatment with the patient that is concordant with the 
patient's values 

• helping patients to share power and responsibility by 
involving them in choices to the degree that they wish 
for disease self-management. 

Research has demonstrated that a patient-centered 
approach to services may have several advantages in terms of 
clinical efficacy and policy making. Indeed, patient-centered 
care is a predictor of different patient-related outcomes, 
including reductions in symptom burden or relapses, length 
of hospital stay and rates of referrals, increases in treatment 
adherence, and importantly improvement in patient satis- 
faction and quality of life.'' " Given its relation with health 
outcomes, patient-centeredness appears to be an important 
process of care, particularly for the increasingly widespread 
chronic diseases, which involve long-term treatments and a 
more active role of patients in symptom self-management. 
Indeed, some evidence suggests that about 70% of patients 
only partially follow medical prescriptions, and approxi- 
mately 30% do not adhere to treatment regimens at all.'- In 
addition, patient-centered care has been shown to be associ- 
ated with time-efficient delivery of care and cost-effective 
use of health care resources. For example, some authors have 
observed that medical staff using patient-centered communi- 
cation skills tended to have lower expenditures on diagnostic 
testing.'^ Consequently, the evaluation of patient-centered 
care with valid and reliable tools has become a crucial field 
of research in the last decades. 

Evaluation and measurement of patient- 
centered care in outpatient settings 

Since the development of the PCF, many instruments 
have been constructed as outcome measures of the health 



care pathway.''' The majority of these tools measure only a 
specific aspect of patient-centeredness: the patient's satisfac- 
tion as subjective judgment of satisfaction with regard to the 
received service." Satisfaction and dissatisfaction are not 
considered fully adequate measures of the quality of care, 
because they are affected by such a wide array of different 
factors.'" However, patient-centeredness has been viewed 
as a multidimensional construct that cannot be understood 
only by observing care directly or asking patients to express 
satisfaction judgments about care."" 

In addition, this measurement approach is based on rating 
scale-type questions, requiring the respondent to provide an 
assessment of aspects of the service received, eg, on a scale 
from "very poor" to "excellent". Even though this approach 
is the most developed method today, it has received some 
criticism."^" Some studies have shown that patient expec- 
tations have only an indirect effect on satisfaction, and that 
patients tend to be satisfied even if their personal expectations 
have not been fully met.'^ Moreover, satisfaction judgments 
tend to produce overly positive representations of the ser- 
vice, and do not provide a sensitive measure of the specific 
problems experienced by the patient during treatment.'^ 
Consequently, assessing satisfaction cannot allow to identify 
which health care processes need to be addressed to improve 
patient-related outcomes." '** Some psychosocial variables 
seem related to specific aspects that have to do with the 
treatment course, such as the quality of communication with 
health care operators and the degree of control and involve- 
ment experienced by the patient during treatment." 

In line with these shortcomings, other types of instru- 
ments were developed as outcomes of patient-centered care, 
encompassing all the domains posited by the PCF.^" In the 
Anglo-American health care context, there is an extensive 
body of research on valid and reliable outcome measures of 
patient-centeredness in outpatient settings. For example, in 
the US, the Patient-Perceived Patient-Centeredness Scale 
was developed^' as a self-report measure for assessing to 
what extent health care communication focuses on patient's 
needs. The measure consists of 14 items measuring two 
domains. The "eliciting illness experience" domain covers 
health care providers' ability to take into account the point 
of view of the patient. The second domain - finding common 
ground - assesses health care providers' ability to enhance 
patient participation in decision making during the health 
care pathway.^' 

Despite the fact that the PCF was developed in the Anglo- 
American health care context, several measures were devel- 
oped and evaluated as outcomes of patient-centered care in 
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non-English-speaking countries for a variety of settings, 
including hospital outpatient facilities.-^ For example, in 
the French context, Gasquet et aP- developed a 27-item 
tool with satisfactory psychometric properties, measuring 
outpatients' satisfaction with hospital care. The measure 
consists of four subscales reflecting appointment making, 
reception facilities, waiting time, and doctor consultation. 
However, consultation with the doctor is covered by half 
of the items, and quality of communication is limited to the 
doctor-consultation domain. 

Despite most of the available measures in the literature 
assessing patient-centeredness as a multidimensional con- 
struct, short measures could be useful for routine clinical 
practice, and they could overcome some problems related 
to an inadequate ratio of items to dimensions, which is 
in contrast with the psychometric theory of instrument 
development.^^ 

Recently, researchers have developed short-form ques- 
tionnaires in non-English-speaking health care contexts. In 
the Norwegian context, Oltedal et aP'' created a six-item 
measure for inpatient settings, which principal-component 
analyses suggested as having a single-factor structure. In a 
national survey Skudal et aP^ developed the Nordic Patient 
Experience Questionnaire (NORPEQ), a six-item short mea- 
sure of health care global experience. The questionnaire was 
mailed to large samples of Norwegian, Swedish, Fiimish, and 
Faroe Island inpatients. Findings from the analyses showed 
a single-factor structure measuring global experience of 
inpatient health care.^' 

Unidimensional measures of patient-centeredness have 
also been developed for specific health care contexts. For 
example, in the Turkish context, Coban and Kasikci^'' devel- 
oped a unidimensional scale for experience of nursing care: 
the Patient Perception of Hospital Experience of Nursing 
Care. The tool was administered to 150 patients, who were 
discharged from medical and surgical units. Results of fac- 
tor analyses suggested a single-factor structure, measuring 
global experience of nursing care. 

Evaluation of patient-centered 
care in the Italian context 

In the Italian context, the patient-centeredness of care is still 
understudied, and to date there has been a lack of research 
on psychometric tools to assess this construct. Ruggeri et aP' 
developed and evaluated the Verona Services Satisfaction 
Scale, a self-report measure assessing satisfaction with 
psychiatric outpatient services, covering six dimensions 
(professional skills behavior, information, access, efficacy, 



interventions, and relatives' involvement). Gigantesco et aP^ 
developed a 15-item self-report questionnaire to measure 
satisfaction with hospital and community outpatient services. 
However, some limitations of these instruments should be 
considered. First, they focused on satisfaction with mental 
health services exclusively. Moreover, the authors recruited 
small samples of outpatients; therefore, the ratio of number of 
respondents to number of items was inadequate according to 
recommendations.-^^' In addition, in these studies, the factor 
structure of the measures was not tested. 

Gremigni et aP" developed a 13 -item measure - the 
Health Care Communication Questionnaire - a self-report 
questionnaire measuring outpatients' experience with the 
patient-centered communication of nonmedical hospital 
staff. The questionnaire measures four domains of patient- 
centered communication with nonmedical staff: problem 
solving, respect, lack of hostility, and nonverbal immediacy. 
However, this instrument focuses on patient-centeredness 
aspects related to communication with staff. 

More recently, Cioffi et aP' validated a self-report mea- 
sure - the Quality Perception Questionnaire - on a large 
sample of patients recruited in different hospital facilities. 
Despite this measure demonstrating very good psychometric 
properties, it was developed for inpatient settings. In addition, 
it assessed exclusively satisfaction judgments with doctors, 
nursing staff, auxiliary staff, and hospital structures, but did 
not assess aspects related to patient-centeredness, such as 
information about diagnosis and treatment, communication, 
or involvement in decision making. 

Rationale for the current study 

Previous findings have shown that patient-centered care is 
interpreted and enacted differently between cultures, suggest- 
ing that the concept and practice of patient-centered care may 
be influenced by sociocultural factors. In the Italian health 
care context, the patient-centered health care framework is 
not sufficiently developed, as the doctor-patient relationship 
is still considered asymmetrical, with the latter having the 
role of passive recipients of medical instructions.^^ Lamiani 
et al" observed differences in conceptual components of 
patient-centeredness between US doctors and Italian doctors. 
Respecting the patient's autonomy was identified as a core 
aspect of patient-centered care by only the US doctors. The 
Italian group demonstrated a more implicitly paternalistic 
approach. 

As outlined by some authors,''' there is a lack of tools with 
valid and reliable psychometric properties that can be used as 
a global measure to assess patient-centeredness in different 
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outpatient facilities. This issue appears of strong relevance 
in light of the link between the patient-centered approach 
and health outcomes found in the literature.' 

Objectives 

The current study aimed to present a psychometric evalua- 
tion of the Health Services OutPatient Experience (HSOPE) 
questionnaire, a self-report global measure for assessing 
patient-centeredness of health care services in Italian out- 
patient settings. Specifically, the aims were: 

1 . to evaluate exploratory factorial validity and reliability 
of the HSOPE questionnaire on a large sample of Italian 
adult outpatients 

2. to evaluate confirmatory factorial validity of the measure 
and factor invariance across sex on another large sample 
of adult outpatients 

3. to test which aspects of patient-centeredness (measured 
by the HSOPE questionnaire items) could predict overall 
satisfaction with the health care service. 

Patients and methods 

Participants 

The HSOPE questionnaire was administered to 1,532 adult 
outpatients. All the participants received care in outpatient 
facilities at the Santa Maria alle Scotte University Hospital of 
Siena, Italy. Of these, 13 (0.84%) were eliminated due to miss- 
ing data on more than three items of the measure. Therefore, 
the total final sample consisted of 1,519 outpatients. 

Participants were excluded from the study if they were 
younger than 16 years. Fifty-one percent of the sample were 
females. The mean age was 59.22 years (standard deviation 
[SD] =16.26 years), ranging from 17 to 93 years. Twelve 
percent of the sample were young adults, 57% were adults, 
and 32% were older adults. 

The total sample was randomly split in two subsamples 
with homogeneous sample size, subsample 1 (n=788) 
and subsample 2 (n=731), which were used to perform 
exploratory factor analysis (EE\) and confirmatory factor 
analysis (CE\), respectively. Participants' distribution in 
the total sample across the outpatient facilities is provided 
in Table 1. 

Development of the Health Services 
OutPatient Experience questionnaire 

The survey was designed by a multidisciplinary research 
group consisting of academic researchers and health care 
professionals with over 10 years' experience in the measure- 
ment of satisfaction. Specifically, the group consisted of a 



Table I Demographic characteristics and number of participants 
for each of the outpatient facilities in the total sample (n=l,5l9) 



Demographic characteristics 


Mean (SD; range) 


Age, years 


59.22 (16.26; 17-93) 




n (%) 


Age cohort 




Young adults 


182 (12) 


Adults 


865 (57) 


Older adults 


486 (32) 


Females 


775 (5!) 


Outpatient facilities 




Surgery 


217 (14.30) 


Cardiology 


276 (18.20) 


Gynecology 


9 (1.00) 


Orthopedics 


7! (4.70) 


Internal medicine 


469 (30.90) 


Odontostomatology 


123 (8.10) 


Oncology 


9 (1.00) 


Otorhinolaryngology and ophthalmology 


151 (9.90) 


Rehabilitation 


171 (1 1.30) 


Dermatology and rheumatology 


22 (1.40) 



Abbreviation: SD, standard deviation. 



sociologist (AC), a senior statistician and methodologist (FF), 
a statistician (FL), and a psychologist (AP). 

Two main aims were followed durmg the scale development. 
First, the questioimaire needed to include the most important 
aspects of the patient's experience identified within the inter- 
national and the Italian literature that are relevant to outpatients 
irrespective of the disease and the stage of the treatment course. 
Second, it needed to be a short tool, which could be easily 
administered by the nursing staff after the visit. 

The HSOPE questionnaire is a paper-and-pencil self- 
administered brief tool, which was developed as a global 
outcome measure of perceived patient-centeredness of 
the outpatient health care pathway. The questionnaire is 
composed of three sections. The first section is composed 
of two subsections. The first one consists of ten statements 
that reflect experience associated with regard to a variety 
of aspects of outpatient visits (eg, feeling informed regard- 
ing modalities of the outpatient visit, feeling involved in 
decision making about treatment, feeling informed on the 
visit outcomes and the course of the health care pathway, 
feeling provided with clear information when asking 
questions). Question responses are in a 5-point Likert scale 
self-report format ("never" =1, "always" =5). The second 
subsection consists of one item on a 10-point rating scale 
response format (ranging from "very dissatisfied" =1 to 
"very satisfied" =10). The choice of this response format 
was motivated by the aim of measuring overall satisfaction 
also with regard to the outpatient visit. 
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The second section of the HSOPE questionnaire consists 
of three questions in a closed-response format in which the 
outpatient is asked to provide sociodemographic information 
(sex, age, and residence). In the third section one question 
asks suggestions to improve outpatient visits in terms of 
patient-centeredness. 

In our study, the HSOPE questionnaire was administered 
to the outpatients by the nursing staff of each unit immedi- 
ately after the visit. The development of the questionnaire 
followed previous literature on the identification of domains 
and items of relevance to outpatient experience. Two main 
aims were followed during the scale's development. First, the 
questionnaire needed to include the most important aspects of 
patient's experience identified within the international and the 
Italian literature that are relevant to outpatients irrespective 
of the disease and the stage of the treatment course. Second, 
it needed to be a short tool, which can be easily administered 
by the nursing staff after the visit. 

During the first phase of the instrument's construction, the 
Anglo-American and Italian online literature was searched 
for aspects related to experience with regard to outpatient 
settings. Through face-to-face meetings, the contents of some 
questionnaires used in previous surveys in English-speaking 
countries and in Italy were reviewed, including provision of 
information on the visit and treatment course, humanization 
of care, outpatient involvement in decision making, perception 
of competence, management of continuity of care, privacy, 
and overall satisfaction. In particular, the following multidi- 
mensional and unidimensional questionnaires were examined: 
the Picker Patient Experience Questionnaire^^ developed by 
Gasquet et al,^^ the Nordic Patient Experience Questionnaire,^^ 
and the questionnaire developed by Oltedal et aV* for foreign 
contexts: the Quality Perception Questionnaire^' and the 
Verona Satisfaction Scale^' for the Italian context. In addition, 
some reviews and papers on theoretical models of patient- 
centeredness were examined.' 

During meetings, a preliminary list of items was created 
by the research staff, composed of psychologists, statisticians, 
and methodologists, and other health care professionals, 
according to their relevance to the Italian health care con- 
text. Subsequently, the questionnaire was piloted through 
cognitive interviews with 30 outpatients from facilities of the 
Santa Maria alle Scotte University Hospital. The outpatients 
completed the questionnaire, and were asked to comment on 
the relevance of the domains covered and clarity, including 
the response options. Since this version of the questionnaire 
was considered clear and comprehensible by the respondents, 
it was used for the study on its psychometric properties. 



The theoretical model of the HSOPE questionnaire is based on 
viewing patient-centeredness as a unidimensional construct. 
A unidimensional model of the patient's experience construct 
was adopted following the recent development of measures 
in other non-English-speaking countries.^'*'^' In the present 
study, psychometric properties of the first subsection of the 
HSOPE questionnaire were assessed. A copy of the measure 
can be requested from the corresponding author. 

Statistical analysis 

Item distributional properties 

Item distributional properties were tested on the total sample 
(n=1519). HSOPE questiormaires missing more than three 
items were excluded from analysis, with up to three missing 
items replaced with the mean response for that individual. 
The distributional properties of the HSOPE questioimaire 
items were examined by conducting the Kolmogorov- 
Smirnov test and by inspecting the skewness and kurtosis 
indices of the items' distributions. The amount of missing 
data per item was low (1.0%-3.8%). 

Exploratory factor analysis and reliability 

EFA was conducted to evaluate the factor structure of the 
HSOPE questionnaire on subsample 1 (n=788). Reliability 
was evaluated as internal consistency using Cronbach's 
a-coefficients.^'' Reliability coefficients were evaluated 
according to Nunnally and Bernstein" (a>0.70= acceptable, 
a>0.80= good, a>0.90= excellent). The EFA and reliability 
analysis were performed using SPSS version 21. 

Confirmatory factor analysis (CFA) 
and multisample analysis 

CFA was carried out using a structural equation-modeling 
approach.^** Based on the results found with the EFA, we 
tested a model in which all the ten items loaded on a single 
factor. To evaluate goodness of fit of the model to the data, 
values were computed.^** In addition, as recommended by 
Floyd and Widaman,^^ the following fit indices were used: 
the Adjusted Goodness-of-Fit Index (AGFI), the Goodness 
of Fit Index (GFI), the Bentler-Bonett Normed Fit Index 
(NFI), and the Bollen Relative Fit Index (RFI).^'* For these 
indices, values close to 1 represent a good fit. In addition, the 
root mean square residual (RMR) was used as an index of 
fit. For the RMR, values less than 0.08 represent acceptable 
fit, and values less than 0.05 represent good fit.^' A series of 
multisample CFA was also conducted to test for the invari- 
ance of the HSOPE questioimaire factor structure across sex. 
CFA was performed with AMOS version 21. 
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HSOPE questionnaire items as predictors 
of overall satisfaction 

To test which aspects of patient-centeredness could predict 
overall satisfaction, a multiple linear regression analysis was 
conducted using the stepwise method, in which each of the 
HSOPE questionnaire items were entered as independent 
variables and satisfaction scores as dependent variables. 

Results 

Item distributional properties 
of the HSOPE questionnaire 

Item distributional properties of the HSOPE questionnaire 
were tested on the total sample (n=l ,5 1 9). To evaluate the nor- 
mality of items of the HSOPE questionnaire, Kolmogorov- 
Smirnov tests were conducted. Results indicated that the 
distribution of the items was significantly different from a 
normal distribution. In addition, an inspection of kurtosis 
and skewness indices for all the HSOPE questionnaire items 
was conducted. An absolute value on these indices falling 
out of the recommended range between -1 and +1 indicates 
a substantial deviance from normal distribution." Eight 
of the ten items showed a kurtosis or skewness value out 
of the recommended range, suggesting that data for these 
items were abnormally distributed. This observation was 
also supported by inspection of the patterns of response 
frequencies, which revealed that the number of participants 
endorsing these items as "always" or "often" ranged from 
74.90% to 86.40%. 

Differences in the outpatient experience 
as a function of sex and age-group 

Differences in the HSOPE questionnaire scores were exam- 
ined as a function of sex and age group for the total sample 
(n=1519). Independent-sample t-test analyses showed that 
HSOPE questionnaire scores did not significantly differ 
between female and male outpatients (/=1.34, /'<0.001). 
Between-group differences on the HSOPE questionnaire 
scores were tested as a function of age-group. We used 



three group categories to present data by age-group (young 
adults, adults, older adults). The young adult group comprised 
individuals aged between 16 and 39 years, the adult group 
individuals aged between 40 and 69 years, and the older 
adult individuals aged over 69 years. Results of a one-way 
analysis of variance showed a significant difference between 
young adults, adults, and older adults (7^=6.20, P<0.0\). 
Specifically, young adults had significantly lower scores 
on the HSOPE questionnaire than older adults. Means and 
standard deviations for the total sample as a function of sex 
and age cohort are provided in Table 2. 

Objective I : Factorial validity and 
reliability of the HSOPE questionnaire 

Exploratory factor analysis (EFA) 

The EEA was conducted on subsample 1 (n=788). In subsam- 
ple 1, the mean age was 59.32 years old (SD =16.12 years), 
ranging from 1 8 to 9 1 years. Forty-nine percent were female 
outpatients. According to the age-groups previously identi- 
fied, 12% were young adults, 57% were adults, and 31% 
were older adults. 

Prior to the extraction of factors, the assumptions required 
for the EFA were tested. The Kaiser-Meyer-Olkin index of 
sampling adequacy**" result was 0.96, suggesting that the cor- 
relation matrix was appropriate for performing EFA, since it 
has been proposed that Kaiser-Meyer-Olkin values should be 
equal or above |0.60| in order to interpret an EFA solution sat- 
isfactorily.'"' Bartlett's sphericity test*' resulted in significance, 
indicating that the data matrix was not an identity matrix 
(;jf\=6,628.04, P=0.001), and thus suitable for EFA. 

Given the abnormality of two of the HSOPE question- 
naire items, factor extraction was carried out using the prin- 
cipal axis-factoring technique, as recommended by Floyd and 
Widaman.-** Using the criterion of eigenvalue greater than 1 .0, 
only one factor met this requirement. This factor yielded an 
eigenvalue of 6.97, and accounted for a total of 66.37%) of 
the variance in all the ten items. The second and third factors 
yielded eigenvalues of 0.58 and 0.46, respectively. 



Table 2 Means and standard deviations (SDs) on the HSOPE questionnaire as a function of sex and age-group for the total sample 
(n=l,5l9) 



Sex 



Males 
(n=700) 
Mean (SD) 



Age-group 



Females 
(n=740) 
Mean (SD) 



Young adults 
(n=l53) 
Mean (SD) 



Adults 
(n=742) 
Mean (SD) 



Older adults 
(n=4l6) 
Mean (SD) 



Total 

sample 

(n=l,5l9) 

Mean (SD) 



HSOPE 



43.15 (7.48) 



42.61 (7.71) 



41.35 (8.29) 



42.98 (7.64) 



43.80 (6.58) 



42.88 (7.62) 



Note: The young adult group consisted of 1 6- to 39-year-old participants, the adult group consisted of 40- to 69-year-old participants, and the older adult group consisted 
of participants aged over 69 years. 

Abbreviation: HSOPE, Health Services OutPatient Experience. 
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Following recommendations from Floyd and Widamann,^'' 
the number of factors to be extracted was also determined 
by visual inspection of the scree test, which suggested the 
extraction of one factor. The scree plot of the HSOPE ques- 
tionnaire items is presented in Figure 1 . 

Based on these findings, one factor was extracted. The 
inspection of the factor-loading matrix showed that all ten 
items had salient loadings (at least |0.50|) on the factor 
extracted according to recommendations.''^ Consistent with 
Floyd and Widaman's recommendations,^" all values of the 
communalities were greater than 0.50. Factor loadings and 
communalities of each item of the HSOPE questionnaire for 
the single-factor solution are presented in Table 3. 

Reliability 

Reliability was analyzed as internal consistency for sub- 
sample 1 (n=788). Cronbach's a estimate for the HSOPE 
questionnaire score was 0.95 (range of corrected item-total 
correlations =0.73-0.85), suggesting excellent internal con- 
sistency according to criteria proposed by Nunnally and 
Bernstein." In addition, all the corrected item-total score 
correlations were greater than 0.20, as recommended by 
Nunnally and Bernstein." 

Confirmatory factor analysis 

CFA was performed with subsample 2 (n=731) to test the 
single-factor model found with the EFA. In subsample 2, the 
mean age was 59.05 years (SD =16.37 years), ranging from 
17 to 93 years. Forty-eight percent were female outpatients. 
Eleven percent were young adults, 59% were adults, and 
28% were older adults. Since the assumption of multivariate 
normality was violated, the estimation method of unweighted 
least squares was employed to conduct the CFA. 




0- 



123456789 10 

Factor 

Figure 1 Scree plot of eigenvalues of tiie ten HSOPE items. 
Abbreviation: HSOPE, Health Services OutPatient Experience. 



Table 3 Loading (/l,) on a single factor and communalities (h^) of 
the ten items of the HSOPE questionnaire in subsample I (n=788) 



HSOPE questionnaire itenns 






Did you receive clear and comprehensible information 


0.88 


0.77 


from the staff when you asked questions? 






Did you feel at ease in dealing with the staff? 


0.86 


0.74 


Did you feel that your concerns were taken into 


0.84 


0.71 


account by the staff? 






Were you informed by the staff about the outcome of 


0.84 


0.71 


the visit and the course of the health care pathway? 






Were the staff competent during the outpatient visit? 


0.82 


0.67 


Did you feel involved in decision making regarding 


0.81 


0.66 


treatment? 






Were the staff courteous and helpful? 


0.81 


0.65 


Where necessary, were you able to find a doctor who 


0.78 


0.60 


was willing to give you the information you needed? 






Were you adequately informed about the outpatient 


0.75 


0.57 


visit modalities? 






Did the staff respect your privacy needs during the visit? 


0.74 


0.56 



Abbreviation: HSOPE, Health Services OutPatient Experience. 



The test result was significant (x^^=\%.22, P<0.01). 
However, as suggested by Joreskog et al,"*^ the test is an 
index depending upon the sample size. Consequently, all the 
other indices were considered for goodness of fit. All the 
indices suggested good fit of the model to the data (GFI =0.99, 
AGFI =0.99, NFI =0.99, RFI =0.99, RMR =0.021). 

Since the single-factor model showed good fit in all the 
considered indices, the results seemed to support the theo- 
retical assumption of unidimensionality of the measure. An 
overview of fit indices for the single-factor model of the 
HSOPE questionnaire specified is provided in Table 4. 

Objective 2: Factor invariance across sex 

A series of multisample CFA were conducted to simultane- 
ously test the invariance of the single-factor structure of the 
HSOPE questionnaire across female and male outpatients. 
Subsample 2 was split into two groups based on sex: male out- 
patient group (n=351) and female outpatient group (n=380). 

The x~ test result for both the groups was significant. 
However, all the other indices supported a single factor for 
both the male and the female outpatient groups. An overview 



Table 4 Fit indices of the HSOPE questionnaire for a single- 
factor model tested on subsample 2 (n=73 I) 



Model 
tested 


(P-value) 


GFI 


AGFI 


NFI 


RFI 


RMR 


Single-factor 
model 


18.22* 
(0.001) 


0.99 


0.99 


0.99 


0.99 


0.021 



Note: *P<0.05. 

Abbreviations: HSOPE, Health Services OutPatient Experience; GFI, Goodness- 
of-Fit Index; AGFI, Adjusted GFI; NFI, Normed Fit Index; RFI, Relative Fit Index; 
RMR, root mean square residual. 
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of fit indices for a single-factor model of the HSOPE ques- 
tionnaire is provided in Table 5 for the male female outpatient 
groups. 

Objective 3: HSOPE questionnaire items 
as predictors of overall satisfaction 

Multiple linear regression analysis was conducted for the 
total study sample (n=l,519) to examine which HSOPE 
questionnaire items were significant predictors of overall 
satisfaction. Results suggested that item 9 ("Did you receive 
clear and comprehensible information from the staff when 
you asked questions?"), item 1 ("Were you adequately 
informed about the outpatient visit modalities?"), item 3 
("Were the staff competent during the outpatient visit?"), 
item 10 ("Were the staff courteous and helpful?"), item 2 
("Where necessary, were you able to find a doctor who was 
willing to give you the information you needed?"), item 4 
("Did you feel that your concerns were taken into account by 
the staff?"), and item 6 ("Did you feel involved in decision 
making regarding treatment?"), but not the other items of the 
questionnaire, significantly predicted overall satisfaction. An 
overview of estimates of the stepwise regression analysis is 
provided in Table 6. 

Discussion 

In outpatient settings, the patient-centered care pathway 
is related to health outcomes in terms of clinical efficacy, 
treatment adherence, and cost efficiency.'' ' However, in 
the Italian health care field, patient-centeredness appears to 
be still understudied, and there is a lack of tools to measure 
the outcome of outpatient health care pathways from the 
patient's perspective. Some research suggests that in our 
context, the doctor-patient relationship is still asymmetri- 
cal, with the latter being considered by health professionals 
to be a passive recipient of medical prescriptions." To our 

Table 5 Comparison of fit indices for a single-factor model of the 
HSOPE questionnaire across the male outpatient group and the 
female outpatient group extracted from subsample 2 (n=73 I ) 



Model tested / (P-value) GFI AGFI NFI RFI RMR 



Single-factor model 






Male outpatient 


1 1.73* 


0.99 0.99 0.99 0.99 0.025 


group (n=3S 1) 


(0.00!) 




Single-factor model 






Female outpatient 


12.71* 


0.99 0.99 0.99 0.99 0.026 


group (n=380) 


(0.00!) 





Note: *P<0.05. 

Abbreviations: HSOPE, Health Services OutPatient Experience; GFI, Goodness- 
of-Fit Index; AGFI, Adjusted GFI; NFI, Normed Fit Index; RFI, Relative Fit Index; 
RMR, root mean square residual. 



Table 6 Summary of statistics of regression analysis for the total 
study sample (n= 1,519) 



Model 


P 


t 


P-value 


Constant 








Item 9 


0.12 


3.15 


0.002 


Item 1 


0.18 


5.48 


0.00! 


Item 3 


0.09 


2.58 


0.010 0.35 


Item 10 


0.1 1 


3.10 


0.002 


Item 4 


0.1 1 


2.92 


0.004 


Item 2 


0.07 


2.04 


0.04! 



Notes: HSOPE questionnaire items were entered as predictors, and overall 
satisfaction as the dependent variable. Only the items that resulted in significant 
predictors of satisfaction are reported. 

Abbreviation: HSOPE, Health Services OutPatient Experience. 



knowledge, in the Italian context, there is a lack of tools with 
reliable psychometric properties to assess the construct of 
patient-centeredness as a global concept. 

In addition, to our knowledge, available instruments 
lack adequate psychometric evidence, due to the small size 
of samples and lack of data on factor structure from EEA 
or CPA analyses.^** Moreover, some of these tools focused 
only on patient-centered care in specific settings, such 
as psychiatric outpatient services,^' assessed satisfaction 
judgments exclusively,^' or assessed only the aspects of 
patient-centeredness related to communication.^" 

The current study presented a psychometric evaluation 
of the self-administered HSOPE questionnaire. Specifically, 
factorial validity and reliability were assessed. The HSOPE 
questionnaire is a general patient-centered outcome measure, 
aimed at assessing patient-centeredness as a global construct 
considered to be common to different types of outpatient 
settings. The HSOPE questionnaire is a brief tool, which can 
be administered by nursing staff, and these characteristics can 
make it suitable for outpatient settings. The measure contains 
statements related to perceived technical effectiveness of the 
staff (eg, "Were the staff competent during the outpatient 
visit?"), to information (eg, "Were you informed by the staff 
about the outcome of the visit and the course of the health care 
pathway?"), to relational aspects of outpatient-staff interaction 
(eg, "Did you feel that your concerns were taken into account by 
the staff?"), or involvement in decision making (eg, "Did you 
feel involved in decision making regarding treatment?"). 

A strength of our study was that two large samples 
were used to test for factor structure with EFA and CR4 
procedures, respectively. Therefore, the ratio of number of 
participants to the number of items was satisfactory.^'' The 
low rates of nonresponse found in our study suggest that the 
HSOPE questionnaire is an instrument with strong levels 
of feasibility and acceptability. The HSOPE questionnaire 
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showed excellent psychometric properties. EFA and CFA 
strongly supported a single-factor solution of the question- 
naire, which showed a clearly defined structure, as all the 
ten items had salient loadings (/l^>|0.50|) on a single factor 
exclusively, and no cross-loadings were observed. In addi- 
tion, the magnitude of the communalities suggested that 
a single factor explained a substantial proportion of vari- 
ance in all items. A single-factor structure of the HSOPE 
questionnaire appeared to be invariant across sex, since it 
was supported for both male and female outpatient groups. 
Moreover, psychometric properties were supported by reli- 
ability as internal consistency, which was excellent. Results 
of the analyses suggested that patient-centered care may be 
viewed as a unidimensional construct, encompassing both 
aspects related to technical effectiveness, information, and 
relations with the staff and involvement in decision making. 
These findings appear to be in contrast with previous work on 
patient-centeredness tools for outpatient settings developed in 
other non-English-speaking countries,^^ which suggested that 
patient-centered care is a multidimensional construct based 
on separate but correlated factors, such as communication, 
information, or clinical effectiveness. 

A strength of our work was that the samples recruited 
represented all the adult age-groups, including young adults, 
adults, and older adults. Interestingly, young adult outpa- 
tients had significantly lower scores on perceived patient- 
centeredness compared to older adults. These findings appear 
consistent with the general evidence found in the literature, 
suggesting that older age is associated with greater satisfac- 
tion and perceived patient-centeredness.*" "^ 

In contrast, no significant difference was found on 
perceived patient-centered care between male and female 
outpatients. This finding was consistent with previous 
research indicating that sex is not a significant predictor of 
satisfaction for outpatient visits."' 

Limitations and future directions 

Some limitations of the current study should be considered. 
First, we did not use comparator measures of patient- 
centeredness to assess the concurrent and discriminant 
validity of the HSOPE questionnaire. In addition, in our 
samples, not all the hospital facilities were represented, such 
as psychiatry facilities. In addition, outpatients from some 
facilities were underrepresented, such as outpatients from 
oncology and from gynecology facilities. 

Another limitation concerns the fact that all the outpatients 
who participated in the study were recruited in a single site. 
Using a multisite design, future research should investigate 



psychometric properties of the HSOPE questionnaire in 
samples from community outpatient settings also. Despite 
an attempt being made in our study to examine differences 
in patient-centeredness as a function of sex or age-group, future 
research using the HSOPE questioimaire should investigate 
additional predictors of patient-centeredness, such as quality 
of life or self-efficacy in disease self-management. Finally, the 
HSOPE questionnaire could be adopted as a patient-centered 
outcome measure in research using randomized controlled 
trials evaluating the effectiveness of outpatient treatments. 

Future research could use the questionnaire as a tool 
to evaluate efficacy of interventions aimed at increasing 
relational skills of health care professionals. The tool could 
also be used as an instrument to assess the efficacy of inter- 
ventions aimed at improving the organizational well-being 
of health care professionals. These implications could be 
related to the close link between patient-centeredness and 
patient health,"'"* and between patient-centeredness and 
work-related well-being of the staff."' 

In conclusion, the current study is the first to our knowl- 
edge to present an instrument to measure patient-centeredness 
as a global construct for a variety of outpatient settings in 
the Italian context. The HSOPE questionnaire seems to have 
reliable psychometric properties and to be a promising tool 
to inform policy making, since the Italian health care context 
is still characterized by the biomedical framework. 
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